An All-Inclusive Efficient Region of Updates for Least Change Secant Methods

نویسندگان

  • Henry Wolkowicz
  • Qing Zhao
چکیده

Least change secant methods, for function minimization, depend on nding a \good" symmetric positive deenite update to approximate the Hessian. This update contains new curvature information while simultaneously preserving, as much as possible, the built up information from the previous update. Updates are generally derived using measures of least change based on some function of the eigen-values of the (scaled) Hessian. A new approach for nding good least change updates is the multicriteria problem of Byrd. This uses the deviation from unity, of the n eigenvalues of the scaled update, as measures of least change. The eecient (multicriteria optimal) class for this problem is the Broyden class on the \good" side of the symmetric rank one (SR1) update. It is called the Broyden EEcient Class. This paper uses the framework of multicriteria optimization, and the eigenvalues of the scaled (sized) and inverse scaled updates, to study the question of what is a good update. In particular, it is shown that the basic multicriteria notions of eeciency and proper eeciency yield a region of updates that contains the well known updates studied to date. This provides a uniied framework for deriving updates. First, the inverse eecient class is found. It is then shown that the Broyden eecient class and inverse eecient class are in fact also proper eecient classes. Then, allowing sizing and an additional function in the multi-criteria problem, results in a two parameter eecient region of updates that includes many of the updates studied to date, e.g., it includes the Oren-Luenberger self-scaling updates, as well as the Broyden EEcient Class. This eecient region, called the Self-Scaling EEcient Region, is proper eecient and lies between two curves, where the rst curve is determined by the sized SR1 updates while the second curve consists of the optimal conditioned updates. Numerical tests are included that compare updates inside and outside the eecient region.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Local Convergence Theory of Inexact Newton Methods Based on Structured Least Change Updates

In this paper we introduce a local convergence theory for Least Change Secant Update methods. This theory includes most known methods of this class, as well as some new interesting quasi-Newton methods. Further, we prove that this class of LCSU updates may be used to generate iterative linear methods to solve the Newton linear equation in the Inexact-Newton context. Convergence at a ¡j-superlin...

متن کامل

Using an Efficient Penalty Method for Solving Linear Least Square Problem with Nonlinear Constraints

In this paper, we use a penalty method for solving the linear least squares problem with nonlinear constraints. In each iteration of penalty methods for solving the problem, the calculation of projected Hessian matrix is required. Given that the objective function is linear least squares, projected Hessian matrix of the penalty function consists of two parts that the exact amount of a part of i...

متن کامل

Historical Development of the BFGS Secant Method and Its Characterization Properties by Joanna Maria Papakonstantinou

Historical Development of the BFGS Secant Method and Its Characterization Properties by Joanna Maria Papakonstantinou The BFGS secant method is the preferred secant method for finite-dimensional unconstrained optimization. The first part of this research consists of recounting the historical development of secant methods in general and the BFGS secant method in particular. Many people believe t...

متن کامل

Quasi-newton Methods for Nonlinear Least Squares Focusing on Curvatures

Most existing quasi-Newton methods for nonlinear least squares problems incorporate both linear and nonlinear information in the secant update. These methods exhibit good theoretical properties, but are not especially accurate in practice. The objective of this paper is to propose quasi-Newton methods that only update the nonlinearities. We show two advantages of such updates. First, fast conve...

متن کامل

Quasi-Newton updates with weighted secant equations

We provide a formula for variational quasi-Newton updates with multiple weighted secant equations. The derivation of the formula leads to a Sylvester equation in the correction matrix. Examples are given.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • SIAM Journal on Optimization

دوره 5  شماره 

صفحات  -

تاریخ انتشار 1995